Expanding the potential for disk-directed I/O

نویسنده

  • David Kotz
چکیده

As parallel computers are increasingly used to run scienti c applications with large data sets, and as processor speeds continue to increase, it becomes more important to provide fast, e ective parallel le systems for data storage and for temporary les. In an earlier work we demonstrated that a technique we call disk-directed I/O has the potential to provide consistent high performance for large, collective, structured I/O requests. In this paper we expand on this potential by demonstrating the ability of a disk-directed I/O system to read irregular subsets of data from a le, and to lter and distribute incoming data according to data-dependent functions.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Interfaces for Disk-directed I/o

In other papers I propose the idea of disk directed I O for multiprocessor le systems Those papers focus on the performance advantages and capabilities of disk directed I O but say little about the application programmer s interface or about the interface between the compute pro cessors and I O processors In this short note I discuss the requirements for these interfaces and look at many existi...

متن کامل

Tuning Starfish

STARFISH is a parallel le system simulator we built for our research into the concept of disk directed I O In this report we detail steps taken to tune the le systems supported by STARFISH which include a traditional parallel le system with caching and a disk directed I O system In particular we now support two phase I O use smarter disk scheduling increased the maximumnumber of outstanding req...

متن کامل

Disk - directed I / O for an Out - of - core

New le systems are critical to obtain good I/O performance on large multiprocessors. Several researchers have suggested the use of collective le-system operations, in which all processes in an application cooperate in each I/O request. Others have suggested that the traditional low-level interface (read, write, seek) be augmented with various higher-level requests (e.g., read matrix), allowing ...

متن کامل

Disk-Directed I/O for an Out-of-Core Computation

New le systems are critical to obtain good I/O performance on large multiprocessors. Several researchers have suggested the use of collective le-system operations, in which all processes in an application cooperate in each I/O request. Others have suggested that the traditional lowlevel interface (read, write, seek) be augmented with various higher-level requests (e.g., read matrix), allowing t...

متن کامل

Enwrich: a Compute-processor Write Caching Scheme for Parallel File Systems Apratim Purakayastha 2 Enwrich: a Compute-processor Write Caching Scheme for Parallel File Systems *

Many parallel scientific applications need high-performance I/O. Unfortunately, end-to-end parallel-I/O performance has not been able to keep up with substantial improvements in parallel-I/O hardware because of poor parallel file-system software. Many radical changes, both at the interface level and the implementation level, have recently been proposed. One such proposed interface is collective...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 1995